MARKET INSIGHTS, INC.

Author

Joseph H

1 Intoduction

Hello, I’m Joseph from Morocco.

Inspired by Hans Rosling’s TED Talk, I taught myself data scraping, analysis, and visualization.
This non-academic approach has given me a unique perspective, as reflected in my projects—though it also means I may require a thorough onboarding process to align with team standards.

I’m open to starting as an intern, either full-time or part-time. Regarding time zones, I’m in UTC+1, but I’m flexible and can adjust my schedule to accommodate the team’s needs.

Feel free to reach me at joseph.ergo@proton.me, and to visit my website for more projects josephelhaddad.github.io.

This custom report, generated from processing 1.4 TB of public data locally, aims to explore the workforce dynamics of a company—up to 2020.
Essentially, I am doing research on a company that does research.

2 About the project

The project came to life after realizing that web scraping doesn’t allow deep-level filtering—without consuming too much time.The irony is, this project itself took me about a month, but the final RDB contains more data than I could ever scrape.

The raw data was 1.4 TB in size and holds information previously scraped.
Processing was done on my local machine using Python, Polars, and DuckDB, following this workflow:
- Processed raw data into structured Parquet files using Polars.
- Transformed each Parquet file into mini RDBs using Polars.
- Merged all mini RDBs into one using DuckDB.
- Analyzed and filtered data to fit the current project.

Alt text

3 EDA

3.1 market research indestry’s yearly new recruit count

3.2 market insights, inc.’s workforce status over the years

4 Workforce sample

4.1 Abraham Shapiro

Job title: Consultant, price elasticity of demand study
Associated: False
Socials: https://linkedin.com/in/abraham-shapiro-166a23a8

4.1.1 Abraham Shapiro’s working period at market insights, inc.

4.1.2 Gantt plot of Abraham Shapiro’s experience

4.2 Arshia Mohazab

Job title: Coffee shop attendant
Associated: True
Socials: https://linkedin.com/in/arshia-mohazab-577088177

4.2.1 Arshia Mohazab’s working period at market insights, inc.

4.2.2 Gantt plot of Arshia Mohazab’s experience

4.3 Audrey Fitzsimmons

Job title: Market research analyst
Associated: False
Socials: https://linkedin.com/in/audrey-fitzsimmons-00438b40 | https://linkedin.com/in/audreyfitzsimmons

4.3.1 Audrey Fitzsimmons’s working period at market insights, inc.

4.3.2 Gantt plot of Audrey Fitzsimmons’s experience

4.4 Brady Walen

Job title: Director of marketing
Associated: False
Socials: https://twitter.com/bradywalen | https://linkedin.com/in/bradywalen | https://linkedin.com/in/brady-walen-7325735 | https://facebook.com/bradywalen

4.4.1 Brady Walen’s working period at market insights, inc.

4.4.2 Gantt plot of Brady Walen’s experience

4.5 Emilli Durent

Job title: Restaurant
Associated: True
Socials: https://linkedin.com/in/emilli-durent-a19902169

4.5.1 Emilli Durent’s working period at market insights, inc.

4.5.2 Gantt plot of Emilli Durent’s experience

4.6 Eric Benson

Job title: Project manager
Associated: False
Socials: https://linkedin.com/in/eric-benson-028b62

4.6.1 Eric Benson’s working period at market insights, inc.

4.6.2 Gantt plot of Eric Benson’s experience

4.7 Jim Perry

Job title: Senior strategist
Associated: True
Socials: https://linkedin.com/in/jim-perry-69976a3 | https://linkedin.com/in/jasperry | https://twitter.com/mi_jim

4.7.1 Jim Perry’s working period at market insights, inc.

4.7.2 Gantt plot of Jim Perry’s experience

4.8 Kelton Toles

Job title: Research interviewer
Associated: False
Socials: https://linkedin.com/in/kelton-toles-32217138

4.8.1 Kelton Toles’s working period at market insights, inc.

4.8.2 Gantt plot of Kelton Toles’s experience

4.9 Larry Fisher

Job title: Sales manager
Associated: False
Socials: https://linkedin.com/in/larry-fisher-1931145

4.9.1 Larry Fisher’s working period at market insights, inc.

4.9.2 Gantt plot of Larry Fisher’s experience

4.10 Lori Soderholm-Weber

Job title: Senior project manager - chicago and nyc
Associated: False
Socials: https://linkedin.com/in/lori-soderholm-weber-19007b6 | https://linkedin.com/in/lorisoderholm

4.10.1 Lori Soderholm-Weber’s working period at market insights, inc.

4.10.2 Gantt plot of Lori Soderholm-Weber’s experience

4.11 Michaela Cagle

Job title: Research analyst
Associated: True
Socials: https://linkedin.com/in/michaelacagle

4.11.1 Michaela Cagle’s working period at market insights, inc.

4.11.2 Gantt plot of Michaela Cagle’s experience

4.12 Nicole Davis

Job title: Project manager
Associated: False
Socials: https://linkedin.com/in/nicole-davis-409a17

4.12.1 Nicole Davis’s working period at market insights, inc.

4.12.2 Gantt plot of Nicole Davis’s experience

4.13 Prince Patel

Job title: B.com
Associated: True
Socials: https://linkedin.com/in/prince-patel-22184239

4.13.1 Prince Patel’s working period at market insights, inc.

4.13.2 Gantt plot of Prince Patel’s experience

4.14 Sarah Balqis

Job title: Research assistant
Associated: True
Socials: https://linkedin.com/in/sarah-balqis-b25225165

4.14.1 Sarah Balqis’s working period at market insights, inc.

4.14.2 Gantt plot of Sarah Balqis’s experience

4.15 Stacey Hampson

Job title: Regional manager
Associated: False
Socials: https://linkedin.com/in/stacey-hampson-39ab462

4.15.1 Stacey Hampson’s working period at market insights, inc.

4.15.2 Gantt plot of Stacey Hampson’s experience

4.16 Travis Mccafferty

Job title: Project manager
Associated: False
Socials: https://linkedin.com/in/travis-mccafferty | https://linkedin.com/in/travis-mccafferty-148a0731